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A Comparison of CHEM Study Classes and Traditional Curriculum Classes 

with Respect to Achievement and Attitudinal Measlires 

* " ._ 

Fr^mofes Lawrenz and Arlen Gullicksoti 

University of Minnesota ^ 

Prior to 1959, jno§^. of the new chemistry texts consisted of the core 
of knowledge from previous texts with a few new sections^to cover the modr 
ern^ developments. No attempt-s were made to reorganize the material or tcS'.^ 

• • • . . 

develop new approaches to it. Textbook publishers could not afford to gam- 
ble on something untried (Ridgeway, 1971). 

In 1959 an American CheiD^cal Society Committee recognized the need for 
an Innovative Approach to chemistry teaching and recommended that something 
dra^ic be done (Ridgeway, 1971). Tl*e J^^tional Science Foundation agreed to 
fund the research and in 1960 tha Chfemical Education Hater ia/^Study (CHEMS) 
began uhder the chairmanlhip ,of Glenn Seaborg, freed from stifling financial 
ct)nsiderations. For a total of three years', text and laboratory materials 
wei^e tested, edited, and^retested. Teacher \:rainijig for the CPEMS course 
was implemented and in 1963 the hard cover edition was published for general * 



use. 



The^re have been \nany ^articles and studies written about different facets 

• • * ' * * * ^ 

of CHEMS. Tl^ey can be divided into two general •categories : nonexperimental 

and quasi-experimental. , The nonexperimental studieli include general descrip-- 

tions, historical documentation, subject matter comparison and philosophical 

evaluations.' The qu^^-experlmental studies deal mainly with student achieve-. 

^ment. They shoW e^sen^ially no differences between the CHEMS students and tjie 

traditional studeiits in knowledge of chemistry .(e.g. , Rainey; 1964; Forchtrieis, 



1968; Schaff and Westmeyer, 1970; Altendorf, 1965.) In Heath and Stickell^s 
(1963) study, the CHEMS students tended to do better on the CHEMS exams while 
thej traditional students tended to do better on the traditional exams. The 
differences were not significant. . • ■ 

In a recent study by tfroxel (1970), however, signil-icant differences were 
reported. He foui\d ^students using CHEMS to perform significantly b^etter than 
students using Modern Chemistry bn (1) the American Chetaistry Society \lsxam, 
(2) th€^ Test bn Understanding Science, and (3) the Watson-^laser Critical 
Thinking Appraisal. Also, the students in CHEMS rated their chemistry class 
signifi^cantly higher on the Prouse Sybject Preference Survey than the students 
in Modern Chemistry . This could support the suggestion of^orqhtner (1968)> 
that the CHEMS program provided a more relaxed, friendly classroom atmosphere. ' 
If the classroom atmosphere is indeed more relaxed antf friendly, it is likely 
a student would prefer it. ^' 

M / ' ■ 

In general, previous studies have had two major shortcomings: (1) the 

, / ^ , ■ ^ 

studies were quasi-experimental in nal;ure, i.e., instead of randomly assigning 
treatments to selected classes, classes were seJLected so that all treatment 
groups were repjresented, and (p , analysis of data was doite by using the student 
rather ^han the diss as the basic statistical unit which can pVoduce serious 
nonindep^ndence problems arid result in misleading conclusions (Glass, 1970). 
Although this study wa^" als9 a quasi-experiment , three potential selection . 
biases were statistically removed fcy using the three variables as covar;Lates. 
The nonindep^^ndence problems were elviminated by using the, class rathei:* than 
the student as the basis for analysis. ' " 

This study investigated three questions: '(1) Is there a difference in 
achievement between classes using CHEMS and- cJLasses using Hodern Chemi6gry? ^ " 



(2) Is there/a difference in attitude between classes using CHEMS and classeb 
using Modern^ Chemistry ? (3) Do ^he burriculums havfr a differential effect on 
*the'atfility groupk?^ (e.g», pos^^ibly the high ability tlasses would do better 
Wjtth CHEMS while the diverse ability classes would do lietter with Modern ' 
Chemis{:ry >) • ^ ' . * ' - 

-J ■ - ■ " ■ 

r * - . Procedure ^ . . '-^ ^ 

The datfa use<i in this study ,are a portion of the data collected as base 
i.ine information for a National Science Foundation evaluation* project (Welch 
and Gullickson, 1972). Chemistry classes ia bne geographical region of the 
United States were selected for testing. As Figure 1 -illustrates, ' the region 
includes South Dakota, Nortli Dakota, Minnesota*; Iowa, Nebraska, Wyoming,. 

o^^dtah, Idaho, and Montana. * • 



» * Insert^Figure 1 about here 

The population centets in these regions w^re stratified into three groups 
above 50,000,'! (2) 10,000 to 50,000, ^nd (3) under 10,000, To insure that 
the sample was representative of the population distribution of the region, a 
percentage (population in strata per total region^ population) of .the^schools 
in each strata was selected.^ To select^*^the sample, a list was made of air the 
schools in each strata, the^iis-t j<7as entered randomly (using actable of random 
numbers) , and the sq^ools were selected systematically to dbtain the desired 
percentage, e.g., every third school. The principal of eaciv chosen sdhool -was 
asked to randomly select a chefaistry teacher by drawing a name from ^ hat ^on- 
taining' the names of all the chemistry teachers. That .teacl^er was aske^^to* 

J ^ ^ ^ ' \ ' . • , 

*Does not include Hennepin and Ramsey counties (Twin Citltes and suburbs) • 



complete a questionnaire, the Science Attitude Inventory ^SAI) (Moore,- 1967) 
hd the*Science Process Inventory (SPI) (Welch, . 196]6) . In addition^* t^e. / 
teacher administered four instruments, to one randomly selected chemistry' 



class. (All teachers- .were given spe^fic instructions on 'how to select 

the class.) The four instruments were: <1) Test on Achievement in Science 

^ ' * . ' ^ ^ ^ ' V 

(TAS), ,(2) Science Procesa* Inventory (SPI)., (3) Science Attitude , Inventory 

(SAI), and (4) Leamitig Environment Inventory^ (LEI) (Anderson, *1971). The 

instruments were completed in April of 1972, 

The TAS is an instrument compiled from the items made available? for pub- 

lie usfe from the National Assessmentp^ducation Project Test in Science for 

1 - 

seventeen-year olds. The items selected db^ not involve the use of^ apparatus 
and were answered correctly by more than 5 percent but less than 90 percent 
of the students in the national assessment. there are 45 six-option items 
with a last option of, "I don't know." The expected mean for any seventeen- 
year old is 22.4. ^ , . ' 

The SPI is a measure of understanding the py^ocesses of science. It con- 

sists of 135 items with eitlier -agree or disagree as a response. The SAI mear 

\ • ^ / , 

sures attitudes toward science. ' It contains 60 items each with the options: 

' ^ ■ '■ ■ ■ 

. agree, strongly agree, disagfee^^^^tld strongly disagree. 

A modified v«rsi6n of the 15 scale LEI was used/ It contains' the 10 scales 
fcha'tf*. showed maximum discrimination: (1^ Diversity, (2) "Formality, (3) Friction, 



V 



(4) Goal Direction, (5)' Favoritisoij^ (6) Difficulty, (7) Democratic, (8) Clique-^ 



ness, . (9)' Satisfaction, and (10) Disprganization. .Five of these scale^ were 
selected for this dtudy:' Diversity, Formality, Friction, ^Difficulty, and Sat- 
isf action. It was feltrthat these scales would be more sensitive to the effect 
o'f a particular curriculum than the others. The LEI contains a total, of 70 

y • • / ^ 

items each with the opt^ns: strongly agree, , agree, disagree, and strongly 



Mti^gree. 



/. ' ■ f . ^ • 6 

■J. ' ■ 

• In order to complete* the entire testing program in one clasp period, 
the class was divided into thirds with one- third taking the TAS/ one-third 
taking the SPI, and the remaining third, taking both the SAX and LEI. This 
division was accomplished by ordering tflie student instruments before Xhe 

■ • ^ • ■ • ■ , 

j teacher received them so that as the teacher passed them out the 'first 
student would receive, the TAS, the second student would receive the' SPI, 
the third* stydent would receive the LEI-SAI corabinatiot^, ,and -the fourth 
student Would receive the TAS and so on. 

. The sampled classes were, separated into two grbtips on the basis of what 
text the teacher said the class was usingr/^ (1) Chemistry , An E^tperimental ' 
S cience and its revisions which are Chemistry. , An Investigative Apprpagh ; 
Chemistry ; Experiments and Principles ; and Chemis.try , ExpeiJ.mental Foundations ; 
and (2) Modern Chemistry , These two groups contain^^ a total oi 57 classes 
of which 33 (57.9 percent) used CHE^ and 24 (4^.1 percent) used Modern 
. chemistry ; 'These two groups were then stratified by ability to provide a 
basis for the in^restigation of \nteraction. The teacher's opinion of whether 
the class's ability makeup was high, average or diversified was used as the 
measure of ability. ' A« Table 1 shows these divisions provided .a 2 x3 factorial 
design. with type of curriculum, arid class ability as* the factors'. ^ 



Insert Table 1 about here / ' ' f 



The eight dependent vari^fe^les. were class mean scores on the SPI,. TAS, SAI, 
and the five chosen LEI scales (see Table 2>. The TAS arid SPI sco^s-were 
analyzed simultaneously by multivariate analysis of variance, and the remaining^ 



six attitudiij^ variables were analyzed univariately. 

' .; 7 ^ _ 

Insert Table '2 ^about here 
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TABLE 1 

Number of Classes in Each Category of Curricula and Ability 





High 


Average 


-« , 

Diverse - 




Factors 


Abilitjr^' 


Ability 


Ability 


Totals 






^ J— 







CHEM Study 12 14 7 33 

Modern . ' - 

Chemistry U_ _4 ^ ' 24 

Totals 26 . 18, " U * 57 



' tABLE 2 • 

Weans and Standard Deviations of Class Means in Each Category of Curricula and Ability 



Scale 



High Ability Hfgh Ability 

, CHEMS rtodem Chemistry 



Average Ability Average* Ability * 
CHEMS Modern Chemistry 



Diverse 
CHEMS. 



sd 



sd 



sd 



.sd 



^kve: 



ivefse 
Modem Chemistry 

sd 



, TAS . ' 
\ SPI 
SAI ' 

Diversity 
Formality 
Friction 
. Difficulty 



3^55 

' 10^-5^ 7.40 



113.17 



.2.83 



2.61 



2.97 



SatlsfactiGn 2.61 



7.29 



.14 



.23.' 



.18 



.13 



.34 



25.32 
106.61 
112.43 

2.85 • 
. 2.5,7 
2.23 
2.87 
2.69 



2.94 
5.44 
6,95 
..0'8. 
.20 
-.21 
.17 
-.22 



'24.74 
104.68. 
116.01 

2.84 

2.68 
• 2.21 

2.98. 

2.52 



8.-06 • -^^.^S 
.9^ 109.52. 
111.27 
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7.15 
-.13 

. -17 
.24» 
.'20 
.26 



I 

2.82 



2.65' 



2.25 
2.18' 
3.49 
.18 



25.79 



2.54 



.98.80 



'.20 



2.21 V • i 



.11 



2.94 . 
2 



'.36\ 



113.95 



2.90- 



"2.66 



2.15 



3.03 



2.36 



13.31 



6.86 



.11 



.29' 



*35 



.27 



;36- 



23.64 
99.74 , 
114.17 
2.76 
2.54 
1.-97 
2'. 87 
2.80 



4.73 
8.25 
4.29 
.08 
.25 
:39 
.21 
.48 



■ Analysis 

>Th£ three variables chosen as covariates were: (1) teacher ^s knowledge 
of the processes of science as measured by the SPI, (2) teacher Vs attitude 
"itowaYd science as measured by the SAL, and (3) the size of theticltles within 
.which schools were located. Of those three only the teacher SPI scores 
"cont^ibjrted significantly. It had a significant effect ovstudent SPI and 
SA/' scores. » , * . 

Of the three questions investigated, i.e. ,* differences in curtlculup, 
differences in ability, and the interaction) of curriculum and abJLlity, the 
knowledge and achievement variables (SPI and TAS) support a rejection ofc 
the null hypothesis (p^^j05)i^only for differences in ability (see Table 3) . 
(That difference was pjLanned for via, the* teacher ratings and subsequent 
categorizatJ.on before analysis,.) 



insert Table 3 about^ here 
Because the multivariate F value for ability difference w^s significant,- 



the univariate F tests ^or ability bn, the TAS and SPI were reported in. Tajble 4,/ 
The univariate F value fot the student SPI scores "was sigttif leant (p<_«01), and 
Scheefe^ests of the abilit-y group means (see Table 5j showed thafboth the 
high and the average ability classes obtained signif icaxitly higher scores than* 
the diverse ability clashes', the lower score of the diverse group was expected 
because of the inclusion of^^ low ability ^tud^nt scores in the class 'iQ^dns • 

Insert Tables 4 and 5 about here 



* Although the univariate F for the TAS scores was not significant at the- 

.05 level, the combined means do show the .expected trend of . high ability classes 

•» . * . 

obtaining tl^e "'highest score followed by the average classes and finally the 

■ * ' , ' ' \ ^ - ' 

.13 
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TABLE 3 



^ (TAS and SPI# Scores) 



Source of Variatiotii 


d.f. 


F 


Curriculum 


2 ' 


. .76 


Ability 


4 


2.55* 


Abilityoc Curriculum 


• 4 


.77 



*p<;^05 



10 



Multivariate F Tests , . - 




14 



> 



TABLE 5 

Combined Ability Means for Student SPI Scoreff 



Class Ability Level 




SPI Score 

«• X 








High 


26 


,105,9 ■ 


Average ' 


18 


107.1 








tlvevse 


13 . 


99 




\ 

.0 >, • 



reported in Table 7, -CHEMS^' classes obtained the .higher Difficulty score and 



diverse classes. This^lends support to the^ opinion that ability differehcies 

do fexist. ' 1 ' • . i:U 

■ " ■ ■ \^ ' ■ -/(t ^ 

The three tests referring to cutriculum, ability, and curriculum^t/y , 

ability interaction were done on eaoli of the six attitudinal, depende^lt 

variables. 'As Table 6 shows, only t:wo significant differences wererobtained. 

\ • ^ ' ^ f 

Both wer^e due to curriculum (CHEMSjvs. .Modem) and the significaati^' differences 

\ ^ ^ ^ ' ' : '1 : 

(p<v05) ojjicurred ior the Difficulty and Satisfaction scales of ^e LEIr As * 

Modern Chemistry classes obtained the higher Satisdcaction scoire. These .scotes 

, • ' ^ . S i ' ■ 

sugge^,t« l^at students perceive CHEMS as more difficult and X^ss satisfying 

M» * ^ ■ ^' ' ' 

■* « ^ , ' . \ ' 

than Modern Chemistry * 



Insert Tables 6 and 7 about here ' 

Conclusions and Dfscussioi> of Results ' *- / 

As *pre^iously stated, this study had three main questions of i interest. In 
answering thle first question (Is there a difference in achievement between' 
clasj^es ^uslng CHEMS and classes using Modern Chemistry? ), the iesults agreed 
with the bulk of studies done to date. There was no difference in student 

achievement in chemistry when taught* by CHEMS or Modern ChemjLstry . That is, 

« . ^ ' ^ 

student acTiievement in chemistry was independent of which curriculum was used., 

AlthougJ^^'^thjt^study did not provide answers to tTie- general quality of eithfer 
currftulum, the average TA& score for all of these classes as previously shown 
in Table 2' was above^the National' Assessment expected mean of. 22.4. One would 
anticipate a higher average score because the expected • score was computed for 
all seventeen-year old^ regardless of their science background/ while the stu- 
dents in this study/were all chemistry students. Howey,er, it Is encouraging 



^ TABLE 6 



Anova: Univariate ^ Tests * 



Source of 
Variations 



d.f. 



Diversity 



MS 



Formality Friction 'Difficulty Satisfaction 

MS F ' .MS ■ F« MS ■ ■ F ' MS F' MS 



SAX 



Curriculum 


1 


.007 


.465 


.05 


.999 


.011 


.172 


.131'' 


3.8* 


*499 • 


' 5.36* 


.0083 


.0002 


Ability; 




;0QQ9 


.06 

* 


, .023 ' 


.46 


.063 


1.01 


.009 


.?5 


.047 ' 


.50 


6.01 ' 


.17 


Ability X 
Curriculum ' 


2 


...022 


1.5 


.ai 


' .21 


.043 


r 

.69. . 


.0009- , 


.025 . 


..08- 


.87 


47.89 


1.21 


Error 


46 


• .bis* ' 




.05 . 




.062 


t 


.034 




..093 




39.6$ . 


t ^ 



< *p<.057 



r 



18 



. -19 



1 



* ' ' ' TABLE 7 

* \ 

Combined' TJext Means for Dif jci^tilty and Satisfaction Scores 



15 



<5? 



Type of 
C^ri;iculum 



N 



Difficulty Satisfaction 



CHEM Study 33 



Moderij Chemistry 24 



2.995 
•2.894 

! 



2.488 



2.726 



^ 



•i < 
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to note that both curricula did increase the students' general knowledge * 
of science. ' ' . - 

Examining the secoi^ question (Is there a difference' in attitude betweeiv 
dlasses using CI^^ or Modern Chemistry ?) led to the conclusion that students 
percjitye CHEMS as more difficult and less satisfying than Modem Chemistry , 
CHEMS proviides a different approach to learning than Aost traditional high 
school^ clas^s^ This "newness" couM^e causing the perception of difficulty 
ratji^r than the actual course content. However,- since the testing was done 
near *th€? end of the school year, the student -Should be 'adjuated to the. new \j 
approach.^ xAlso, since the CH^EMS laboratory does not have any '"right" answers,* 

• ■ .' ■ \ \ ■ ■ ~ . 

the students might not get as much of a feeling of satisfaction as the Modem 
Chemistry students who "prove" something they already kndw. The LEI scales 
of Formality and Friction did .not show a significant difference, consequently, 
this study ""did riot support Forchtner's (1968) view that GSS^ provides a more 
relaxed, friendly atmosphere. ' - • 

None of the differences In the SAI mean, scores wer^ significant, but it 
Is inter^sfting to note* that all of the class mean scores were above 112. This t 
score is well above the neutral attitude s^ore of 90. Apparently all the 
classes involved in this i^tudy had poaritive attitudiss toward science 1 

According tQXthe information obtained in this study/ the answer to the * ' 

third question (Do the curriculums have a differential effect on ^e^ ability 

groups?) is no. There was no significant interaction between curriculum and 

* * • . 

-ability for any of 'the eight dependent yariableai:. Therefore, there is^no^ 
indicatioir that one curriculum is better or worse for a particular type of 
.class. This'^result is^ reassuring because it would Rrobably be quite difficult 
for schools to provide different chemistry curricula for different ability le^/el 
classes. , " . . " - ' ^ ^ 

J • S *' ' ^ m * 

■, ' .\ ' 



-J 
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At the present time whea much is being done to emphasise Nthe^new o 

curriculum ♦materials, e.g., CHEM Studies .^ it is somewhat feasting to 

* ■ • . - ' f ' ' 

note that tradUrlonal courses such as Modern Cheagsfcry- are ef f^ttlve as / 

well. Giv^ the results of this stiidy together witk the results pf the 

other ' studies mentioned, it seems appropriate to say Ijhat^f a scliool i^*'^ 

making a text adoption and is trying to decide between'^^HIEMS^ and Mgdern ' 

Chemistry the decision is probably best made on factors othkr than expected 

Student achievement, ability, or attitude. Variables 'such, as teacher pre- 

ference, knowledge #nd familiarity with the two curricula, 'and equipment' ^ 

/. * • ^ 

and facilities available in the school would provide better information 



for the adoption decision. 



). 
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